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1 Introduction 

Being able to count right cosets contained in a double coset with respect to a unimodular 
group U, i. e. being able to determine the cardinality of U\UAU for any given matrix A 
of appropriate format, is helpful in a multitude of 

The formula presented in this article originally has been studied in the field of Hecke 
algebras. If we want to carry out computational analysis in Hecke theory, we need an 
algorithm that allows us to multiply two elements of an abstract Hecke algebra. Since 
the product can be calculated by a multiplication of representatives of right cosets, the 
task of multiplying elements of an abstract Hecke algebra can essentially be reduced to 
the search for decompositions of double cosets into right cosets. Knowing how many 
cosets we have to find allows us to state a randomised algorithm which carries out the 
decomposition. Moreover, there is an application in the proof of a theoretical result 
on abstract Hecke algebras. In the "classic" Hecke algebra Hn related to the GL„(Z), 
certain products in if„ can be reduced to products in Hn-i- With the presented result 
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this reduction theorem can be generahsed to Hecke algebras related to arbitrary norm- 
finite Dedekind domains in the case n = 2. Details of these two applications to Hecke 
algebras can be found in section O 

Another application is shown in section HI The set of right cosets with respect to U 
which are contained in UAU can be related to a right transversal of a certain subgroup 
of U depending on A. For some special matrices A these subgroups turn out to be 
congruence subgroups, so we are enabled to calculate indexes of certain congruence 
subgroups of U . 

The remaining sections of this article are organised as follows: In the following section, 
the notation used in this article is fixed and some basic facts which are used throughout 
this article are assembled. After that, the main result - a formula for the cardinality of 
U\UAU - is stated and proved in section [31 

This article is developed from a talk I gave some time ago in the research seminar 
"Computational Algebra and Number Theory" of Fritz Grunewald, whose unexpected 
death in 2010 means a great loss for the mathematical community. 

2 Preliminaries and Notation 

Denote by o a norm-finite Dedekind domain, i. e. a Dedekind domain in which |o/ao| < oo 
holds for every a G o (where |M| is the cardinality of the set M). Furthermore, denote 
by K the field of fractions of o, and by o* the group of unities of o; then denote by 
Vp(a) the multiplicity of a prime ideal p in the ideal a of o (fundamental properties of 
Dedekind domains and multiplicities can be found for example in [T] Chapter II). 

Let / be the set of (2 x 2) matrices with entries in o and non-zero determinant; 
furthermore, denote by U the set of matrices in / with determinant in o* (in other words 
U = GL2(o) and I = GL2(/s:) n o^^^). por A = (;! ^) e o^^^ de&nes the first and 
second determinantal divisor of A by di{A) = ao + bo + co + do and d2{A) = {detA)o, 
respectively. Furthermore, ti{A) := <^i{A) and t2{A) := d2{A)di{A)~^ are called the 
elementary divisors of A. Additionally, define the fundamental factors fi{A) := Ci{A) = 
9i(A) and f2{A) := t2{A)ti{A)-^ = d2{A)di{A)-^ and introduce the notation g{A) for 
the g. c. d. of the first column of A, i. e. q{A) = ao + co. 

The relation between determinantal divisors and double cosets of U is given in the 
following theorem, which goes back to Steinitz ([2], see also [3| Theorem 2.2). 

2.1 Theorem. Let A, B E o^''^ 

a) If A and B have rank 2 (i.e., ii A,B G /), the following assertions are equivalent: 

(i) UAU = UBU, (ii) di{A) = di{B) and 02(A) = ^2(5). 

b) If A and B have rank 1 and the first columns of A and B both contain at least 
one non-zero element, the following assertions are equivalent: (i) UAU = UBU, 

(ii) dM)=MB) ands(A) =0(5). 

In these assertions, the di can also be replaced by the Cj or the fj. o 
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This theorem can not only be used to characterise the equahty of double cosets, but 
also has an application in the proof of the following corollary which allows to state a 
relation between different generators of the same ideal in o. 

2.2 Corollary. Let a,b,c,d G o such that ao + bo = co + do. Then there exists an 
ReU satisiying R{t) = id)- o 

Proof. In the case c = d = we also have a = b = and can choose R = ( q ? ) • For the 



a ' 
b . 



remaining part of the proof assume c 7^ (without loss of generality). Let A 
and B = q). Since A and B both have rank 1 and satisfy f i(A) = as well as 

q{A) = g{B), Theorem 12.11 vields the existence of P, Q G t/ such that PAQ = B and 
thus PA = BQ-\ Writing P = and Q"^ = itlll) and calculating PA as well 

as BQ~^ we obtain 

fpia + p2b 0\ / cqi cq2\ 
[psa + P46 Oj \dqi dq2 j ' 

In particular, we have cq2 = 0, and since c 7^ 0, this implies q2 = 0. Thus det = qiq^, 
which implies qi G 0*. If we define R = qi^P, we thus have R E U. Furthermore, 

^"^"^1 [psa + p.b 0) - 

which proves R{t) = id) and completes the proof. □ 

2.3 Remark. Since there exists a version of Theorem 12. II for A,B E ^nxn arbitrary 
n G N (see e.g. [3] Theorem 2.2), Corollary 12.21 can easily be generalised from two 
generators to an arbitrary number of generators of an ideal, as long as the number of 
generators on both sides of the equation are the same. o 






3 Counting right cosets 

In this section a formula for the number of right cosets in a given double coset of U is 
derived. To begin with, a short example shows how coset counting is carried out in the 
"nice classic case" = Z. This will serve as a guideline for the subsequent analysis of 
the general case. 

3.1 Example. Let = Z. Since is a principal ideal domain, every right coset UB for 
B E I has a unique representative 




with a,d > and <b < d 



known as the Hermite normal form of B. Given this normal form, the number of right 
cosets in a given double coset UAU can be obtained by generating all possible normal 
forms (in a sensible way) and deciding whether they belong to UAU. The latter can be 
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carried out using Theorem 12. II to test for UB'U = UAU, so it has to be checked whether 
X,^(B') = and 02(5') = d2iA) hold. 

As a concrete example construct every right coset representative B' as above contained 
in UAU where A = (04). Since 02 (^) = ^2{B') is a necessary condition for UB'U = 
UAU, the equation (det A)Z = (det-B')Z and thus 4 = ad has to be satisfied. So there 
are three possible cases: (i) a = 4 and d = 1, (ii) a = 2 and d = 2, and (iii) a = 1 and 
d = 4. For these cases determine, for which values of b the equation UB'U = UAU is 
fulfilled. To this end, it suffices to test whether f i(-B') = ^i{A) holds since a and d have 
already been constructed to satisfy d2{B') = 02(A). 

Case (i): Since d = 1 and < b < d = 1, only the case 6 = has to be analysed. 
Then we have Oi (5') = aZ + 6Z + rfZ = 4Z + 0Z+ IZ = IZ = 1Z + 4Z = ()i(v4), so (^?) 
is a right coset representative in UAU. 

Case (ii): Since d = 2 and < 6 < = 2, the cases 6 = and 6 = 1 have to be 
considered. For 6 = we have c)i(-B') = 2Z 7^ IZ = di{A), so (02) element of 

UAU. For 6 = 1, however, we have Oi(5') = IZ = Oi(A), so (H) belongs to UAU. 

Case (iii): Since d = 4 and < 6 < = 4, the cases 6 G {0,1,2,3} have to be 
analysed. Due to a = 1 we have fi(i?') = IZ = fi(A) in any of these cases, so (04) 
belongs to UAU for every 6 G {0, 1, 2, 3}. 

Summarising, in UAU we have found the 6 right coset representatives (q?), (02); 



Generalising these considerations, a formula for the number fi{A) of right cosets con- 
tained in UAU can be stated: 



(where N = {1, 2, 3, . . . , } and Nq = {0, 1,2,.. .}). The cardinality of a set {6 e Nq | 6 < 
d and aZ+bZ+dZ = di{A)} can be calculated explicitly, which finally leads to a product 
formula for fJ.{A) (not presented in detail since the same steps are to be done for the 



The first main ingredient of the approach taken in Example 13. II in the classic case was 
the Hermite normal form. In the general case, another normal form can be constructed 
- not as "nice" as in the classic case, but nevertheless solving the issue of a uniquely 
determined representative. 

3.2 Lemma. Let a be an ideal in and 6 G a. Choose an a G o satisfying a ^ 
and ao + 60 = a (always possible since is a Dedekind domain) and a transversal T of 
(0 n ab^^o)/{ba^^o fl ab^^o). This transversal is finite, and for every A G / satisfying 
q{A) = a and ^2(^4) = 60 there exists a uniquely determined c G T such that 



(04)5 (04)5 (04)5 ( 4 ) • 



^(A) = J2 |{6 G No I 6 < ci and ^Z + bZ + dZ = Oi(A)}| 



dldot A 



general case in the following). 



o 




o 
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Proof. The finiteness of T follows from the norm-finiteness of o since ba fl a6 is 
an ideal in o. 



To prove the uniqueness of c, assume 

U 



a c — 1 ^ 
b ba^^Ci 




for c,d & T. Since then 





d+1 ab~'^{d-c)\ 
- d) l-c + d J 

has to be an element of f/, we obtain in particular ab~^{d — c) G o and ba^^{c — c/) G o, 
which yields (i — c G ba^^o fl ab^^o. Since T is a transversal modulo ba^^o fl ab^^o and 
c,dET, this shows c = d and thus proves the uniqueness of the representative. 

In the remaining part of the proof the existence of the desired representative is shown. 
Let A e I satisfying g{A) = a and 02 (^) = bo. Since ao + bo = q{A), by Corollary 
22] there exists a Pi E U such that P^A = (H). Then let e = b{det{PiA))-^ G o* 
and P2 = (oi) ^ ^5 such that det(P2-Pi^) = b. Furthermore, the Chinese Remainder 
Theorem allows us to choose a p G satisfying/) G {onba~^o)+e~^ andp G (ona6~^o) + l 
since fl ba~^ and fl ab~^o are relatively prime. The matrix 







P3 

then is an element of 0^^^ with det P3 = 1, and we have 
PsP,PiA = P,P,(l 

with det(P3P2Pi^) = b, so if the second column of P3P2Piyl is denoted by ( ^ ), we have 
as — br = b and thus 1 + r = ab~^s G ab~^o. Since furthermore 1 + r G 0, by the choice 
of T there exists a c G T satisfying 1 + r G c + {ba~^o fl ab~^o). Now let 

Then P4 G 0^^^ and det P4 = 1 (since ab~^s = 1 + r and c — r — 1 G ba'^o fl afc^^o), and 
putting everything together we have P4P3P2P1 G t/ and 

PiP^P2PlA = P4 




a r\ la{ab ^s — r) ab ^s{c — 1) — cr + r\ fa c — 1' 
.b sj I as — br ba~^ c{ab'^ s — r) j \b ba~^cj 



which shows the existence of a representative with the desired form and thus completes 
the proof. □ 
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With this normal form, a first elementary formula for the number of right cosets with 
a prescribed g. c. d. of the first column can be given. (All elements of a right coset with 
respect to U have the same g. c. d. of the first column, so it is possible to talk about the 
g. c. d. of the first column of a right coset.) 

3.3 Corollary. Let A G / and a an ideal of o such that ^i{A) \ a \ d2{A). Choose an 
a G satisfying ao + d2{A) = a (possible since a \ d2{A) and o is a Dedekind domain), let 
q = a^^a as well as b = a~^d2{A), and choose a transversal T of q/qb. Then the number 
fia{A) of right cosets in UAU with a as g. c. d. of the first column can be calculated by 

fiaiA) = |{c G T I a + (c - 1)0 + cq-^b = 



o 



Proof. Since a = ao + d2{A) = aq + ab, the ideals q and b are relatively prime, which 
yields o n a()2{A)-^ = o n qb"^ = q as well as d2{A)a-'^ n ad2{A)-'^ = bq"^ n qb"^ = bq. 
Thus T is a transversal of (o fl ai)2{A)-'^)/{d2{A)a-^ n aD2{A)-^). 

If UB for some i? G / is a right coset in UAU satisfying g{B) = a, then in particular 
^2{B) = 02(^), and according to Lemma [22] there exists a uniquely determined repres- 
entative C of UB of the form described in that Lemma (with b = det A and c E T, the 
latter according to the first paragraph of this proof). Thus 

{UB \B el with q{B) = a and UB C UAU} 
I a c — 1 



UB 



B 



for some c E T and B E U AU 



and since '02(B) 



/i„(A) 



det A (det A)a~^c 
d2{A) for those B, Theorem 12. II and ao + 'C>2{A) 
I I a c — 1 



a yield 



cG T 



det A (det A)a 



-1, 



MA) 



□ 



= \{ceT I + (c- l)o + cq~^b = r)i(A)}|. 

The formula presented in Corollary 13.31 is only a first step since it is not very far from 
a mere enumeration of right cosets. The next step is the establishment of a product 
formula for the cardinality on the right-hand side. To achieve this, we first need some 
auxiliary results. 

3.4 Lemma. In the setting of Corollary 13.31 the following assertions are equivalent: 

(i) c I a + (c - 1)0 + cq"^b. 

(ii) c I a and ac \ 'i)2{A) and c | c — 1. o 



Proof. First assume that (i) is satisfied and show that (ii) is fulfilled. Since (i) implies 
c I (c — 1)0 + cq~^b and c and c — 1 are relatively prime, we have c | q~^b and thus 
ac I oq^^b = a~^a02{A), which implies ac | f2(^) since a G a. The remaining parts of 
(ii) follow obviously. 

Now assume that (ii) is fulfilled. For the proof of (i) it remains to show c | cq^^b. 
But this follows from ac | ^2(^4) and c G q since the latter implies c | a~^02(A) = b and 
cq~^ C 0, so the proof is complete. □ 
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The second auxiliary result gives an explicit formula for the cardinality of a certain 
subset of T needed in the calculation of /ia(^)- 



3.5 Lemma. In the setting of Corollary 13.31 we have 

\{ceT\c- lec}\ = N(b)N(c)-^ 

for every ideal c of o satisfying c | a | 02 (A) c^^ o 

Proof. In the given setting we have c | b, and b and q are relatively prime, so c and q 
are relatively prime. By the Chinese Remainder Theorem there exists a(ieqn(c + l). 
Then {c — d \ c & T, c — 1 G c} is a transversal of cq/bq: All those c — d are elements of 
c n q = cq, the (c — rf) + bq are pairwise different since T is a transversal of q/bq, and for 
every a; G cq there exists a c G T satisfying x G {c — d) + bq, namely the one satisfying 
X + d & c+ bq, which exists in T since x + d & q and is an element of {c G T | c — 1 G c} 
since x + dGc+bqCc + c and thus c— lEx + {d — l) + c = c. Now the definition and 
the multiphcity of the norm yields |{cgT|c— lGc}| = |cq/bq| = N(b) N(c)~^. □ 

Now we are prepared to prove a product formula for /ia(^). 

3.6 Theorem. Let A e I and o be an ideal in o. If | a | d2{A)di{A)~'^, then 

p|a0i(A)-i+02(A)0i(A)-ia-i 

otherwise, fia{A) = holds. o 

Proof. If fia{A) > 0, then there exists a, B E UAU having a as g. c. d. of the first 
column. Then = Oi(-B) | a and a | 02 = ^2{A), so Corollarv 13.31 is apphcable. 

Thus, using the notation introduced in Corollary 13.31 there exists a c G T satisfying 
a + (c — l)o + cq^^b = So Lemma 13.41 implies adi{A) \ ^2(^)5 which shows 

that a I 02(^)0 is necessary for fia{^) > 0. Thus it is proved that = if 

^i{A) I a I 02(^)c)i(v4)"i does not hold. 

In the following assume fi(^) | a | d2{A)'0i{A)^^. Denote by £l the set of all prime 
ideals of dividing d2{A)di{A)-'^, let M = {c G T | a + (c - l)o + cq-^b = 
and M(c) = {c e T \ c divides a + (c — l)o + cq^^b} for all ideals c of 0. By the 
inclusion-exclusion principle we then have 



IM| = (-1)""' 



M{MA) n q 



If for a product q' of pairwise distinct prime ideals di{A)q' \ a \ d2{A)(di{A)q')~^ does 
not hold, then for c = ()i{A)q' the first or the second condition in Lemma l3.4l (ii) is 
violated, which implies |M(c)| = 0. Since 'i)i{A)q' \ a \ 'i)2{A){di{A)q')~^ is equivalent to 
q' I adi{A)~^ and q' | d2{A)di{A)^^ a^^ , in the above formula can be replaced by 0' 
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where £3' denotes the set of all prime ideals of o dividing adi{A)~^ +d2(A)'Cii{A)~^a~^ . In 
the case that q' is a product of pairwise distinct prime ideals in 0', the condition 0i(y4)q' | 
a I 02(A)(0i(v4)q')"^ is satisfied, and Lemma [S31 and Lemma [13] yield M{di{A)q') = 
\{c e T \ divides c - 1}| = N(b) N(Oi(A)q')"^ Plugging this into the above 

formula and using the multiplicity of the norm and the distributive law we obtain 

- ^<'" n(i-Nw-). 



Since \M\ = fia{A) according to Corollarv 13.31 and b = d2{A)a~^, the proof is complete. □ 
The just proved formula will be applied in the following 

3.7 Example. Let o = Z and A = ( q ^ ) as well as a = 2Z. Theorem 13.61 then yields 

p\2Z 

which corresponds to the results of Example EH] where we had exactly one representative 
of type namely ^). o 

Since Theorem 13.61 is just an intermediate result, more interesting cases than o = Z 
will not be discussed at this point. 

The formula for fia{A) given in Theorem 13.61 has several applications. Later we will 
see how it can be used to prove a reduction theorem in the context of Hecke algebras, 
but for now we will stick to the already announced goal of a formula for the number of 
right cosets contained in a given double coset. 

3.8 Theorem. Let Ae I. Then 

^^{A)=miA)) n (1 + N(P)-^). 

p prime ideal 

Plf2(A) O 

Proof. To calculate fi{A), we have to sum over all iJ^aiA). Then we use Theorem 13.61 
and rewrite the obtained sum to use a' = l)2{A)di{A)~^ as summation index: 

a ideal in o 

^ Nrn^Nrn (A)) (i-N(p) ) 

0i(A)|a|02(A)ai(A)-i ^n^*;^n^U^;; p prime ideal 

p|tiOi(A)-i+£)2(A)ai(A)-io-i 

= E N(aO n (l-N(q)-^). 

o|a'|f2(A) q prime ideal 

q|(a')-'f2(A)+a' 
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Using this equality, we can prove the theorem by showing that 

^(b):=5:N(a) n (l-N(q)-i)=N(b) [] (1 + N(q)-^) 

o\a\b q prime ideal q prime ideal 

q|o~ib+o q|b 

holds for every ideal b in o (since b = f2(^) yields the assertion). We carry out an 
induction on the number of prime ideals dividing b. The initial case b = o is obvious, 
so we now assume that there exists a prime ideal p which divides b. Write b = p™r with 
p f r. Analogously split up every a as product of a power of p and a rest not divided by 
p. Introducing the set l3c of prime ideals dividing c^^b + c, we then have 

m 

5(b) = EN(a) n(l-N(q)-^) = EEN(p'^c) [] (l-N(q)-^). 

o|a|b qeiJo fc=OD|c|r 'i^Qpk, 

If p f c and q is a prime ideal in o, the definition of £lpk^ yields 

q e £lpk^ ^ (q = P and 1 < A; < m) or (q 7^ p and q G He)- 

Using this equivalence in the above expression for S{b), by splitting up the outer sum 
we obtain 

m—l 

S{i>) = E E N(c)(l - N(p)-i) n (1 - N(q)-^) 

k=l o|c|r qeQc 

+ EN(c) n(l-N(q)-^) + EN(prN(c) n(l-N(q)-^). 

o|c|r qeQc o|c|r qeOc 

Since the double sum on the right hand side is a telescoping sum, the equation simplifies 
to 

S{b) = E mr-' N(c) n (1 - N(q)-^) + E N(P)"^ N(c) n (1 - N(q)-^) 

o|c|r qeQc o|c|r qeiJc 

= N(p)-(1 + N(p)-i) E N(c) n (1 - N(q)-i) 

o|c|r qeOc 

= N(pr(i+N(p)-i)5(t). 

Applying the induction hypothesis, we have 

^(b) = N(p)™(l + N(p)-i)S(r) = N(pr(l + N(p)-i)N(r) [] (1 + N(q)"') 

q prime ideal 

= N(b) n (l + N(q)-^), 

q prime ideal 
q|b 

which completes the proof. □ 

In the following examples Theorem 13.81 is applied in a case where is not a principal 
ideal domain. 
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3.9 Examples. Let o = Z + Zcj where to = and A = ( q 3 ). Since 3o = pip2 with 
pi = 3o + (cj + 1)0 and p2 = 3o + (w + 2)o, where pi and p2 are prime ideals of norm 3 
in 0, Theorem 13.81 yields 

/i(A) = N(3o) n (1 + N(P)-^) = 9 (1 + ^) (1 + ^) = 16. 

p prime ideal ^ O / \ 6 

p|3o 



Since 2o has the prime ideal decomposition (2o + (w + l)o)^, one similarly obtains 
/^((o 2)) ~ 6. Possible choices for the six representatives are calculated in Example 15. 4i 

The above examples can be generalised: If o is a quadratic number field and p a rational 

lo- 
op. 



prime, we have o p )) = (p + 1)^ if p is split and q p )) = p{p + 1) otherwise. o 



To complete this section, already existing results similar to Theorem 13.81 are shortly 
reviewed in the following 

3.10 Remark. In the case o = Z we have a so called rationality theorem for abstract 
Hecke algebras with respect to unimodular groups (see e.g. [4] Theorem V(9.3)). The 
proof of this theorem uses the fact that the double coset GL„(Z)Pj GL„(Z) where Pj is 
a diagonal matrix with j diagonal entries equal to p (for a fixed rational prime p) and 
the other diagonal entries equal to 1 decomposes into exactly 



l<vi<-<Vj<n 



right cosets with respect to GL„(Z). (One easily checks that for n = 2 and j G {0, 1, 2} 
this yields the same values for /i(Pj) as Theorem 13.81 ) 

Another similar theorem does not count right cosets in double cosets but right cosets 
in the set of all matrices with the same determinant (modulo units). According to [5j 
Theorem 11.4, the set {A G o"^" | det A G do*} decomposes into exactly 

l}p\k N(p)^-i 

p\d 

right cosets with respect to GL„(o) (where P denotes a system of representatives of 
prime elements in o modulo o*). o 



4 Applications to congruence subgroups 

In this section, an application of Theorem 13.81 to the calculation of indexes of certain 
congruence subgroups is presented. 

4.1 Corollary. Let m G o with m 7^ and f/°[m] = {( " d) ^ U \ b E mo}. Then the 
index of ?7°[m] in U can be calculated by 

[[/ : f/0[m]] = N(mo) \{ (1 + N(p)~^). 

p prime ideal 

p|m O 
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Proof. Let A = (l^). A simple calculation using A{^''^)A~^ = (^^"'d'*) shows that 
U n A-^UA = U°[m]. Since [U : U n A-^UA] = fx{A) (see e.g. [6] Lemma 3.1.2), the 
assertion immediately follows from Theorem 13. 8[ □ 

4.2 Remark. Corollary 14.11 generalises a similar formula for the index of congruence 
subgroups in SL2(Z) which is of interest in the theory of modular forms (see e.g. [7] 
Section 1.2). However, such index formulae are studied also in other contexts (see e.g. 
tSj). 



5 Applications to Hecke algebras 

As it has already been mentioned. Theorem 13.81 has been developed with the theory of 
Hecke algebras in mind. The applications in this field will be presented here. 

Denote by H the complex vector space spanned by {luAu I ^ ^ where 1m '■ G 
{0, 1} is the characteristic function of the set M. For A, Ai, . . . , Ak, B, Bi, . . . , Bm G / 
with UAU = UAi U ■ ■ ■ U UAk and UBU = UBi U ■ ■ ■ U UB^ where the unions are 
pairwise disjoint define 

k m 
k=lj=l 

and extend this operation bilinearly to a (well-defined(!)) operation on H. The obtained 
algebra is called an (abstract) Hecke algebra; for details see e.g. |4j. The formula 

(luAu * luBu)iC) = I AB^ eUC, l<t<k, l<j < m}|, 

which can be found in |4j 1.4.4, immediately yields an algorithm for the calculation of 

luAU * luBU- 

5.1 Algorithm, input: A^B E I\ output: D C I and Cc € N for every C E D such 
that 

ucu 

ceD 

(1) Decompose UAU and UBU into pairwise disjoint right cosets UAi, . . . ,UAk and 
UBi, . . . , UBm, respectively. 

(2) Let D = 0. 

(3) For every pair with 1 < i < k and 1 < J < test whether there exists a 
C E D with UAiBjU = UCU; if this is not the case, add the element AiBj to D 
and set ca^b^ = 1; otherwise, if additionally UC = UAiBj is fulfilled, increase cc 
by 1. o 

For the execution of this algorithm, a right coset decomposition of UAU and UBU 
has to be constructed explicitly in step (1). Using Theorem 13. 81 we can give an algorithm 
that carries out this task. 
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5.2 Algorithm, input: A G / and an enumeration {Qn)nen of U; output: right trans- 
versal RofU\ UAU 

(1) Calculate k = fi{A) (using Theorem 13.81) . 

(2) Set R = {A} and n = 1. 

(3) If there exists no B E R with UAQn = UB, add the element AQn to R. 

(4) If \R\ < k, increase n by 1 and go back to Q, otherwise stop. o 

5.3 Remark. In order to implement Algorithm 15.21 we have to enumerate all elements 
of U, which might not be feasible. To avoid this problem, one can use random elements 
instead of enumerated elements for Qn- Then Algorithm l5.2l is turned into a probabilistic 
algorithm which produces the desired output if it terminates. The remaining problem of 
the generation of random unimodular matrices will not be discussed here but is delegated 
to SAGE ([9]). o 

Using Algorithm 15.21 and Remark 15. 3[ we can calculate some 

5.4 Examples. Let o = Z + Zcj for uj = V— 5. For A = (02) the probabilistic decom- 
position algorithm terminates after an average of 14 loop cycles and yields for example 

r/1 o\ (I i\ (I u\ (I (2 0\ ( 2 0\1 

\\0 2J'\0 2)'\0 2J'\0 2 J'\0 lj'\l+uj l) j 

as a system of representatives of U\UAU (with 6 elements according to Examples 13.91) . 
With this transversal it is then possible to use Algorithm 15.11 to calculate luAu * '^uau] 
one obtains 

ll/Al/ * '^UAU = ^UAiU + 6 ■ IUA2U + ^UAsU 

with = ( 1 2 ) and ^2 = ( g § ) as well as A3 = ( 2 ^+^). 

In order to obtain a feeling for the complexity of the decomposition algorithm (a 
detailed analysis has to take into account the strategy for choosing the elements of U 
and will not be carried out in this paper), we execute this algorithm for some more A 
and obtain the following table: 



A ^i{A) 02 (A) fJ'{A) avg. loop cycles 



(10] 
\0 2 ) 





2o 


6 


14 


(1 \ 
I 1+ui ) 





(u; + 1)0 


12 


39 


ihl) 





3o 


16 


53 


ill) 





4o 


24 


110 


( (i ) 





5o 


30 


130 







(1 + 2uj)o 


32 


124 


(0^) 





2a; 


36 


171 



o 
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Theorem 13.81 can not only be used for algorithmic calculations in Hecke algebras; it 
has an application in the proof of a theoretical result on abstract Hecke algebras, too. In 
the "classic" Hecke algebra related to GL„(Z), certain products in Hn can be reduced 
to products in H^-i (see e. g. |1] Lemma V (8.3)). In the case n = 2, the presented result 
yields a lemma which then leads to a generalisation of this reduction theorem to Hecke 
algebras related to arbitrary norm-finite Dedekind domains. 

5.5 Lemma. For all f E H define fioif) = J2a€R f{^) ' fJ'oi^) where i? is a system of 
representatives of U\I/U. Then fio{f * g) = fio{f)fLo{g) for all f,gEH. o 

Proof. By the definition of fi^ and * it suffices to prove the assertion for / = Iuau 
and g = Iubu where A,B G /. For C E I with {Iuau * ^ubu){C) 7^ we have 
C E UAUBU by the definition of *, and [3] Theorem 3.1 yields X)i{A)<)i{B) \ di{C) and 
thus di{A)di{B) I 0(C). This implies that in the case f i(A) 7^ or 'Oi{B) ^ both sides 
of the equation fioi^UAU * ^ubu) = fJ'o{^UAu)fJ'o{^UBu) evaluate to zero, so it remains 
to analyse the case f i(A) = = f i(-B). In this case let Ai, . . . ,Ak and Bi, . . . , B^ 
be systems of representatives of U\UAU and U\UBU, respectively, where the Bj with 
5{Bj) = have the form (g^) (without loss of generality due to Corollary 12. 2|) . Let 
1 < i < k and 1 < j < m. If Q{Bj) 7^ 0, then Q{AiBj) 7^ since the first column of AiBj 
consists of linear combinations of entries of the first column of Bj. If Q{Bj) = 0, then 
the special structure of Bj yields that the first column of A^Bj equals the first column 
of Ai. So we have Q{AiBj) = if and only if Q{Ai) = and Q{Bj) = 0. Since according 
to the definition of /Xp and * we have 

Hoi'^UAu * li/BC/) = I QiABj) = 0, l<i<k, 1 < j < m}\, 

the just proved characterisation of Q{AiBj) = used to split up the right hand side as 
product of two cardinalities yields the assertion. □ 

Now the desired reduction theorem can be stated and proved. 

5.6 Theorem. Let a, 5, c e and A = ( ^ )^ 5 = ( 1 ) ^s well as C = ( 1 « ). Then 
{luAu * ^UBu){C) = 1, if c e abo*, and {Iuau * '^ubu){C) = otherwise. o 

Proof. With R as in Lemma [5.51 write 

fJ^oi'^UAU * '^UBu) = i'^UAU * '^UBu){D) ■ flo{D) 

= E {luAu*luBu){D)-fioiD) + {luAu*luBu){AB)-fioiAB). 

D&R 
DfUABU 

Using Lemma 15. 5[ Theorem 13.61 and the multiplicity of the norm, we have 

fJ^oiluAu * luBu) = /io(lf/Af/)/io(lc/w) = ^{M^)) ^{MB)) = ^{H^B)) = fIo{AB), 
so 

E i^UAU * ^UBu){D) ■ Aio(-D) + {luAU * ^UBU 

){AB)-fio{AB)=fio{AB). 

D€R 
DiUABU 
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Since all numbers in this equation are non-negative integers and {luAU* ^ubu){AB) > 1 
by the definition of *, we have {1uau*^ubu){^B) = 1 and {lifAu*^UBu){D) ■ fio{D) = 
for aW D E R with D ^ UABU. Since Ho{C) > 1 as 0(C) = o, these equations imply 
{luAu * ^UBu)iC) = if C ^ UABU and {Iuau * ^UBu)iC) = 1 if C e UABU, where 
the latter condition is equivalent to c e abo*, which proves the assertion. □ 
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